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ABSTRACT ' 

The primary objective of the Stallings Classroom 
Management Staff Development Model is to help teachers change so that 
they can manage their classrooms more effectively. In this model, 
classroom observations and specific recommendations for teaching 
behaviors are made for each teacher, and a series of teacher ^^training 
sessions helps them to change their behaviors.. Classroom observation 
data are collected at the conclusion of the training sessions, and 
teachers receive profiles showing results of their efforts at 
changing. This 'model uses the Secondary Observation Instrument (SOl), 
which collects information on the teacher and other classroom data, 
records information about the classroom environment and participants 
as in a photo "snapshot,"^ and records the interactions and activities 
taking place each 5 minutes. In this report, an in-depth overview of 
the implementation of this model is presented. Included is' 
information on: (1) the data collection process;" (2) data analysis 
and interpretation; (3) teacher training processes; (4) project 
objectives, rationale, and history; (5) characteristics of the 
schools involved in' the project; (6) demonstration project methods 
and procedures; and (7) project evaluation. Included in the 
appendixes are a sample .observer survey, comments from project 
observers, and demonstration project pre/post profile summation 
forms. (JD) 
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* . QHAPTER I 

INTRODUCTION 

TM Putnam County Classroom Management^ Staff Development Demonstration 

) • ■" 

Project was the result of long term systematic planning and goal-directed 
program development by personnel wi^thin and without the State of West 
Virginia, who came together from time to ' time to collaborate on various 
instructional design, program development, and staff development projects. In 
retrospect, the Putnam County project represents the uniting of various key 
actors with the shared intent of designing, developing, implementing, evaluat- 
ing and reconceptualizing 'a staff development project that would impact a 
school district, central office staff, classroom teachers, and students, and 
provide data-based insights into instruction and learning in general. 

During the period 1971 through ^979, individuals representing the 
University of Houston (competency-based teacher education) , University of 
Texas (research and developmejit in teacher ^education), SRI International 
(systematic observation and teacher effects research), MLM Educational 
Consultant (educational, program developm^ent and evaluation), and the West 
Virginia Department of Education (instructional design and competency-based 
staff development) collaborated on sevq.ral educational development and 
research projects. In 1975 personnel representing^ the W^st Virginia 
Department of Education and MLM Educational Consultant collaborated on the 
developinent ^nd implementation ,of a statewide competency-based staff 
development project in reading which generated cognitive, performance, 
affective and consequence data from various levels of learners. As a result 
of earlier .efforts, personnel in the West Virginia Department of Education 
endorsed ^nd agreed^ to participate in a teacher effects study being initiated 
in 1979 by the founder and president of the Teaching and Learning Institute 

1) 



(TALI). This proposed 1979 • developer/demonstrator project which was not 
funded until 1980, and the evolving collaborative was a spinoff of earlier 
indepencfent collaborative efforts by previously mentioned key actors aad « 
agencies. Then, in 1980 Appalachia Educational Laboratory ("AEL) sponsored a 
conference, "Classroom Management: Improving Basic Skills," in Montgomery," 
Alabama. Ironically, this conference brought together several "old friends" 
who had worked together on various projects, and added -a county school system 
superintendent interested in improving instruction in his schools. 

Previous to the "conference, the founder and president of the Teaching and 
Learning Institute had informed personnel' in the West Virginia Department x)f 
Education that the 1979 proposed study had been funded by the National 
Diffusion Network \nDN) . By that time, the West Virginia SEA representative 
had, in addition to his other responsibilities, assumed the role of Title II 
Basic Skills Director, affording him the opportunity to apply new resources to 
meet targeted "goals. Thus, the AEL Conference indirectly provided the 
opportunity for "old friends" to finalize commitments and begin planning in 



earnest . 



The Putnam County Classroom ilanagement Staff Development Demonstration 
P^:oject was an example of educational decision-makers working in a collabora- 
tive mode to benefit initially teachers and ultimately students. Four 
educational agencies andMcarefully selected staff at various levels formed a 
consortia to help teachers help themselves to become more effective. The 
•educational agencies and personnel forming the consortia were: (1) Putnam 
County Schools (County Superintendent) ; (2) West Virginia Department of 
Education (the Director of Educational Program Development and the Coordinator 
of Reading); (3) Teaching and Learning Institute (President) (4) Appalachia 
Educational Laboratory (Educational Research and Development Specialist) . 



Realizing the challenges involved in' a° far-reaching study of this nature, 
members of the consortia formulated a written plan that attended to all 
project phases: design, developritent , implementation, evaluation and reconcep- 
tualization. Enhancing the written Vommitment and potential for " project 
success was. the knowledge that consortia personnel held common beliefs about- 
teaching and learning, respected .each other's opinions and had proven track- 
records of - sustained, dedicated commitment to the challenge of improving 
teaching and learning: The capacity and ability of consortia personnel to 
work together effectively was never in question. Additionally, agencies and 
personnel involved were willing to commit the necessary resources-human, 
physical and fiscal-to " assure the success of the ^demonstration project and 
the resulting collaborative. 

The Putnam County Classroom Management Staff Development Demonstration 
Project was an outgrowth of the teacher effects research and research-based 
effective teaching practices model developed by Dr. Jane Stallings, formerly 
associated with SRI, and now president and founder of the Teaching and 
Learning -Institute (TALI) in Mountain View, California. The purpose of this 
particular staff development model is -to increase student achievement "through 
data-based, systematic change in teaching behaviors. In deciding to utilize 
the Stallings model, demonstration project planners chose to integrate and 
test the latest, relevant educational research and development (R & D) 
technology into the demonstration schools and the subsequent training of 
teachers. 

The implementation of the Putnam County Classroom Management Staff 
Development Demonstration Prbject and the evolving collaboration, with the 
various phases in the entire process, are detailed in. the following chapters 
of this report. Appropriate graphics related to the demonstration project and 



the resulting collaborative effort, as well as the overall flow of the 
project, are referenced in the narrative and then provided for the reviewer* s 
perusal in the appendices. 

Essentially, the Putnam County Classroom Management Staff Development 
Demonstration Project is the result of comrpon beliefs, respect for those 
beliefs and dedication ,to improving teaching and, learning for the benefit of 
students. The knowledge gained through the implementation and evaluation of 
this project will be used to . develop and disseminate a statewide model for 
staff development in the areas of classtoom and instructional management. 
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CHAPTER II 
THE STA^aLINGS CLASSROOM MANAGEMENT 

STAFF DEVELOPMElJ\MODEL - ^ 

Research Perspectives 

Significant new knowledge about .th'e teaching/learning process in 
public schdols has resulted from educational research undertak^en ia the 
past 20 years. During the late i960 ' s , and" the ' 19J0 ' ^, process-product 
research studies (classroom processes-educational products) identified 
specific classroom teaching practices and variables related to increased 
student achievement in low and medium skilled children and youth. The 
consistency of findings atross several investigations has produced steady 
progress in identifying effective teaching practices. 

First, large-scale correlational studies were 'conducted at the 
elementary education level (StalLings and Kaskowitz, 1974; Soar and Soar, 
1972; McDonald and Elias, 1976; Brophy and Evertson, 1976; and Good and 
Grouws, 1977) to examine actual classroom teaching practices and to 
determine these practices influence upjon student, achievement outcomes. 
Although these studies varied in several ways, there was sufficient 
commonality so that data i^esulting from these studies, most of which were 
conducted in the basic skills areas, provided relatively dependable 
knowledge regarding relationships between teacher behaviors and student << 
learning of reading and mathematics in the elementary grades. Two of the 
most widely known and ^utilized results of these studies ace the concepts 
of ..students t'ime-on-task and the direct instruction model (Rosenshine, 
^ 1979). ; 

Similar studies were conducted at the secondary education level, 
(Stalllngs,« Needels, and Stayrook, 1979; McConnell, 1977; and Anderson, 
-Evertson, and Brophy, 1978) and generally supported the direct instruc- ^ 



tion model of teaching. Furthermore, yjfitallings (1980) extended and 
improved the time-on-task concept by dividing it further into interactive 
instructional activities and non-interactive instructional activities. '^^ 

Next, a series of field studies,* conducted by basically^ the same 
teams of researchers , were conducted in order to investigate using the 
research findings as^a basis for designing teachers V inservice training. 
Conducted in regular classrooms over ^an extended period of time, the 
teachers in these studies were practicing ones rather than specially- 
hired or preservice teachers. Generally, the results of these studies (1) 
showed sj^atistically significant changes inv key teaching behaviors, and 
(2) favored the trained (i.e., treatment teachers^'over the untrained or 
control teachers in producing student learning gains on standardized 
achievement tests. Results from these quasi-experiments supported 
previous correlational outcomes and gave stronger evidence of a possible 
causal linkage, as opposed to mere association, between classroom 
variables and student learning. 

Several of these researchers (Evertson and Emmer, 1980, 1981; 
Sanford,. Clements, and Emmer, 1981; and Stallings, 1980) are now dissem- 
inating and diffusing their research. Different dissemination/diffusion 
strategies are being used. For example, the University of Texas R&D 
Center for Teacher Education researchers have produced a serie§ of 
reports, several training manuals, and a training videotape and have 
conducted numerous dissemination workshops across the country. Stallings 
has designed a system of awareness sessions followed by an apprecticeship 
system. Apprentices are trained in both the Stallings coding system and 
her staff development workshops. After a three week rigoiPous training 
system, apprentices return to their home agencies and implement the 
system for staff development. 



Stallings* findings, based on a fourty-four school study ' (1980) , 
indicate that students make more gains in classrooms where" teachers spend 
rpore time instructing, discussing homework, providing considerable 
supportive feedback, and having students read aloud in small groups. In. 
this environment, the teacher is^ well organized and interacts with 
students during the entire class period. | ^ 

Her findings (1980) also indicate that in classrooms where students 
are not registering achievement gains, a major portion of class time is 
allocated to silent reading and v^ritten assignments, with teachers 
performing organizational and management - activities during the^/lnilk of 
the class period. A basically nbninteractive environment is^a^arent. 

The S tailings research-based staff developmepit: model has been 
implemented by a^ apprentice in the CincinnatixFubli6 Schools. Although 
the model was necessarily modified to jf^^iiit , the peculiaritties of the 
school system, it was a close replica^tion of the Original proce«s;< Ghory 
and Cash (1981°) report these findings: 

1. As a total group, sample teachers improved in the recom- 
mended direction on 25 of^ 31 variables related to five 
project educational priorities. 

2. For the total group the degree of teacher improvement was 
estimated to be statistically significant in the recom- 
mended direction on 9 of 31 variables. 

3 . On the average , teachers with the greatest need showed 
improvement across all selected variables. 

y 

4. Teachers with the greatest need showed statistically 
significant improvement on .18 of 28 variables. ^ 



The research findings of Stallings and Ghory and Cash indicate that 
this particular staff development model is a successful strategy used to 
alter urban teacher's performance on key variables related to student 
achievement. The Putnam Cbunty Demonstration Project was designed to 
determine the model's ap^plicability and success or failure in a rural 
setting. The Putnam County demonstration project sought to determine if 
rural teachers' performances on key variables related to student 
achievement could be altered through the same process. 
II. Description of the Stallings Classroom Management Sti'ff Development Model 
The primary objective of the Stallings Classroom Management Staff 
Development Model, based on the need to increase learners* basic skills 
achievement, is to help* teachers change their classroom behavioral pro- 
cesses in order to organize and i^^age their classrooms more efficiently 
and more effectively. To this end, classroom observations are performed 
and specific recommendations for teaching behaviors are made for each 
teacher based on research findings and systematic classroom observations 
of ' each teacher. A series of teacher training sessions is conducted to 
help teachers try tq change their classroom behaviors and to support them 
in their attempts. Finally, classroom observation data is collected 
sometime after the conclusion of, the teacher^ training sessions a^tk^ 
teachers receive profiles which show the results of their efforts at 
changing. 

The Stallings Classroom Management Staff Development Model follows a 
distinct sequence of activities related to data collection and teacher 
training. The essential steps in the coordinated process I're as follows: 



ERIC 



DATA COLLECTION PROCESS 

recruiting observers 

training observers 

conducting classroom observations 

processing data by computer 

analyzing and interpreting data 

9 

conducting classroom observations 
processing data by computer 
analyzing and interpreting data 



TEACHER TRAINING PROCESS 
recruiting teachers 



planning sessions based on data 
conducting teacher training sessions 



planning final session based on 
data 

conducting final teacher training 
session 



A. Data Collection Process ^ 

The Secondary Observation Instrument (SOI) is the cornerstone of the 
data collection process.. Developed under a continuing National Institute 
of Education Grant by Stallings and Margaret Needels during their tenure 
at SRI, the SOIis a low inference tool designed to Qpllect reliable data 
on classroom activities and teacher.- student interactions. The SOI, a 
teacher-focus type of observation system, is the most recent instrument 
developed by Stallings and is based on the earlier, elementary level 
version. The SOI is recommended for use in all classroom levels and, 
thus, the secondary in the title should not be taken literally. 

The SOI consists of three major parts: Identification and ^lassroom 
' Information, "Classroom Snapshot, and Five-Minute Interactions. Informa- 
tion is recorded' in each section related to student grouping, teacher 
behaviors, and interactions between teachers and students. 



I. 



The Identification and Classroom Information section located on the 

■ i 

front, of, th^ SOI provides ' infonnation necessary for -mta processing and 
analysis. In addition to' information about the teacher, such as the 
assigned teacher number, spaces ^re provided to collect other classroom 
data: number of students enrolled in the class, grade level(s), length 
of class period, and number of adults present. Information on the 
observation itself is also required in this section: name and number of 
the observer, date of * the observation, and the chrCaological order of 
booklets used for observations on a specific teacher. The Identification 
and Classroom Information section sets the stage for data^ processing and 
analysis of the co&pleted SOI. This section is coded only once during'' a 
class period. * * 

The 'Classroom Snapshot is a one page form completed five times 
during each observation session. This Classroom Snapshot records 
information about the classroom environment and the participants as if 
they were being photographed at one instant--a "mental Polaroid." 
Completed immediately before the coding of each Five-Minute Interaction, 
it records every person* s whereabouts and involvement. Essentially, the 
Snapshot, as^ it is commonly called, yields data about materials being 
used, activities occurring, grouping patterns, and involvement of 
teacher, other adults, and students. 

The final part of the SOI is the Five-Minute Interaction (FMI). This 
component that records two different types of information. First, the 
chronological order of the particular FMI being coded and the FMI's 
starting and stopping times are indicated. Second, the interactions and 
activities ^in the classroom are recorded with information falling into 
four columns: who, to whom, what and how. Approximately 300 verbal 
interactions are recorded per observation session. 
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The who column contains codes pertaining to a person 
or a group of persons. These codes are used to identify 
the initiator of the action. 

The to whom column contains the same codes found in 
the who column. However, in this case, it refers, to the 
person(s) to whom the initiator (the who) is directing a 
comment or action. ^ 

The what column c^Snt^ins the categories of observed 
statements or behaviors. The codes detail the essence of 
the comments or actions, such as open-ended questions or 
commands . 

The how column gives information about the action 
and describes its content or effect. Examples of codes 
in this column are reading, organization, and behavior. 
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In completing the SOI, the observer follows this sequence of activities: 

1. Complete Identification and Classroom Information Section on 
' coyer of SOI prior to start of class period. 

2. Divide the cla^s period into five equal segments, notiag the 
starting ticfte for each Snapshot. 

3. Complete Snapshots, and Five-Minute Interactions during the 
class period . 

A graphic display of this sequencle follows. ^ ^ / 
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Data are collected on the SOI for t;eachers during the same class 
period on three consecutive* day^ . Therefor^, a total^ of fifteen class- 
room Snapshots and approximately 900 verbal interactions are recorded. 

The observers are trained by Stallings, Needels, or one of their 
apprentice trainers. Seven full days are devoted to the training 
including practice in simulated and real-life situations. At the end of 
that time, observers are "licensed" only if they have met or exceeded an 
eighty percent reliability level for each separate code. 



Data Analysis and Interpretation 
/ Once the data has be^n Collected using the SOI, the data collection 
^jLnstruments , printed in b6oklet form, are forwarded to INTRAN, Inc. in 
'Minneapolis for optical scanning and processing. At the completion of 
this process, INTRAN sends a computer tape to Stallings . for the final 
step, the computer-generation of teacher profiles. 

The teacher profiles generated by the classroom observation data 
include forty-five teaching variables which, for the purpose of the 
Putnam County Demonstration Project, may be listed, by two grouping 
schemes. Otfe^ scheme classifies the variables as being related to inter- 
active instruction, non-interactive instruction, and off-task (Stallings, / 
1980). The other manner of grouping the variables is by their relation- 
„ ship to instruction, classroom management, and feedback and discipline. 
Table 1 depicts the complete categorization of the f orty-f ive «variablas 
from the computer-produced teacher Classroom Snapshot and Five-Minute 
Interaction profiles. 
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Table 1 

Stallings Staff Development Model Teaching Variables 
(N-AS) Listed by Two Major Grouping Schemes 



Variables Grouped by Three Classification Types 



Variables Grouped by Three* Categories 



Interactive Iris truct ion Variables (N-28) 



Instruction Variables (N«20) 



F5 Adult to Individual Student 
F6 Adult to Groups 
F7 Adult to Class 

F8 Student Direct Question/Reading 

F17 Adult Direct Question/Reading 

F25 Student Response/Reading 

FA3 Student Reading Aloud . 

F45 Adult Instructing Group " ' 

FAS Adult Instructing Groups/Reading 

FA9 Adult Instructing Everyone/Reading - 

F61 Adult Acknowledgement /Reading 

F71 Adult Praise/Support 

F9A All Interactions/Reading' 

F95 All Interactions/Task 

F99 All Interactions/Positive : 

F108 Student Comments Assignments 

F12J0* All Interactior{s/Class Assignment 

F136 Adult/Different Student Starts Interaction 

P137 Different Student/Adult .Starfs Interaction 

F138 All Instruction 

F139 All Supportive Corrections 

FlAl Making Assignments ^ 

SA Total Reading Aloud 

55 Total Making Assignments ^» 

56 Totai Instruction 

57 Total Discussion 

58 Total Practice Drill 

Sll Total non-Math or Reading Instruction 



Non-Interactive Instruction Variables (N«8) 



F50 Machine Instruction 

F91 .All Adult Movement 

F122 Adult Manage Class/No Student 

52 " Teacher Class Manage/No Students 

53 Total Silent Reading 

S9 Total Written Assignnients 

SIO Total Test Taking * 

S15 Total Classroom Management 



Off-Task Variables (N-9) 



F56 All Social Comments 

F96 All Interactions/Behavior 

F102 All Interactions/Negative 

F135 Adult with Outside Intruder 

FIAO All Correctives 

F1A2 All Intrusions 

512 Total Social Interaction 

513 Total Student Uninvolved 
SIA Total Discipline 



F8 Student Direct Question/Reading 

F17 Adult Direct Question/Pleading 

F25 Student Response/Reading 

FA3 Stu'dent Reading Aloud 

FAS ^ Adult Instructing Reading 

FA8 " Adult Instructing Groups/Reading 

FA9 Adult Instructing Everyone/Reading 

F50 Machine Instructing 

F9A All Interactions/Reading 

F95 All Interactions/Task 

F108 Student Comments Assignment 

F138 All Instruction 

S3 Total Silent Reading 

SA Total Reading Aloud 

S6' Total Instruction 

57 TotaJ. Discussion . * 

58 Total Practice Drill 

59 Total Written Assignments 

Sip* Total Test Taking " , 

Sll Total non-Math or Reading Instruction 



Classroom Management Variables (N=17) 



F5 

F6 

F7 

F56 

F91 

F120 

F122 

F135 

F136 

F137 

FlAl 

F1A2 

SZ 

S5 

S12 

S13 

S15 



Adult to Individual Student 

Adult to Groups 

Adult to Class 

All Social Comments 

All Adult Movement 

All Interactions/Class Assignment 

Adult Manage Class/No Student 

Adult with Outside Intruder ? 

Adult/Different Student Starts Interaction 

Different Student/Adult Starts Interaction 

Making Assignments 

All Intrusions 

Teacher Class Manage/No Students 
Total Making Assignments 
Total Socisal Intervention 
Total Student Uninvolved 
Total Classroom Management 



Feedback and Discipline Variables (N=8) 



F61 Adult Acknowledgement/Reading 
. F71 Adult Praise/Support 
F96 All Interactions /Behavior 
F99 All Interactions/Positive ^ 
F102 All Interactions/Negative 
F139 All Supportive Corrections 
FIAO All Correctives 
SIA Total Discipline 
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Examples of the teacher profiles follow. Figure 1 is >a sample 
profile generated by data related to the Snapshot, and Figure 2 is a 
sample profile generated from data from the Five-Minute , Inter- 
actions. » 
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C. Teacher Training Process 

In the Stallings Classroom Management Staff Development Model, a 
small group of teachers attends a series of five workshops conducted by a 
Stallings-trained apprentice. ; Each workshop, while focusing upon a 
s]pecific topi^ and content, is implemented in such a way that fosters a 
support^ive, problem-solving environment. The purpose of the small-group 
approach is to help teachers attempt to alter their own teaching perfor- 
mance based on identified individual n^eds. Each teacher is provided 
with a packet of materials to read prior to each workshop. 

Workshop 1 sets the framework for the remaining four 
' sessions and pjits the entire staff develop^lent process 

within a research context. The Stallings et al. research 
and findings are explained and discussed. Teachers are 
then provided with their individual teaching profiles and 
each variable is explained in detail. Each teacher 
receives his/her own set of recorhmendations for behavior 
change based upon the results of the profile and >a 
\, C"comparison\ to effective teaching behaviors determined 
through Smllings* research. At the end of the session, 
teachers ^ sel'eet a limited number of teaching behaviors 
V--""' they intend to alter. 
^^-^ Workshop, 2 focuses upon student achievement levels^ 



^-^1 grouping, time allocation, and teaching strategies. 
J^'Methods to informally assess student reading ability are 
presented as are methods to develop vocabulary for 
students achieving at various levels. " ^ 
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In Workshop 3 classroom management is the focal ( 
point. 'Teachers are acquainted With efficient ways to 
make assignments and to make their expectations clear to 

students. ^ • 

Workst^ 4 is devoted to behavior management. 

Techniques for motivating students toward good behavior • 

^ •>-■•' 

and achievement are/ discussed as well as ways to handle 
behavior problems . " 

Workshop 5 provides information concerning direct 
instruction, questioning, and feedback. The need for and 
importance of supportive corrective feedback is empha- 
sized, ' - — * " 
The data collection procedure diescribi^d Earlier is duplicated to 
collect post-workshop data on teachers involved in the teacher training 
sessions. Thi$ dat^a collection process, and trie subsequent data analysis 
and interpretation, is performed sometime prior to the end, of the school 
year. A final follpw-up workshop is then conducted and teachers are able 
to compare their two profiles to see whether recommendations from the 
workshops were followed. * 
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j CHAPTER III 

/ PUTNAM COUNTY DEMONSTRATION PROJECT 



Objectives and Rationale 

The Putnam County School system was involved in a demonstration 
project of the S tailings Classroom Management Staff Development Model 
during the 1980-81 school year. The objectives of the demonstration 
project were to : 

1.0 Install, monitor, evaluate, and reconceptualize a demon- 
stration site in Putnam County for the Stallings Class- 
room Management. Staff Development Model.. 

2.0 Establish a framework around which a comprehensive 
instructional improvement program in Putnam County could 
be expanded. 

3,0 Build among^ Putnam County educators an awareness of, and 
the need for, the proje.cted comprehensive ' instructional 
improvement program. 

This,, demonstration proj^ect was preceded by an extensive community- 
based needs assessment completed in 1979. The resultant 1979 Comprehen- 
sive Needs^ Assessment of Putnam County Schools was presented ,to and 
accepted by the Putnam County Board of Education. This extensive needs 
assessment highlighted -^the need for a continued emphasis on basic skills 
instruction in th^ early childhood, middle childhood, and adolescent 
years of the educational prdgram. 

An examination of student achievement data for the county emphasizes 
the need for intervention in the school systems The West Virginia State 
Department of Education (WVDOE) administers a statewide testing system 
for all students in the third, sixth, ninth, and eleventh grades. The 
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norm-ref ereikCed test used in this assessment is the Comprehensive Tests 
of Basic Skills (CTBS) Form S , Table 2 presents th^ results of the 
lastest administration of the CTBS for grades three and six. Shown are 
the results, in terms of^ mean percentile scores, for the nation. West 
Virginia as a whole, th^ five counties surrounding Putnam County, and 
Putnam County. 

Inspection of Table 2, at grade three, reveals that out of 14 CTBS 
subscale scores and their totals. West Virgiuia students as a whole tied 
or '*beat" Putnairf County students a total of nine times. Inspecting grade 
three in Table 2 in terms of comparing Putnam County students to students 
in the five surrounding counties is even more reveal'ing. In 52 out of a 
possible 70 cases of CTBS subscale scores, the five surrounding counties* 
^tudent;s "bettered'* Putnam C^^ty students. Put anotl^^r way, the Putnam 
County thii*d grade students "beat" their surrounding county students only 
18 out of 70 times on grade three CTBS subscale scores. 

Table 2 also' presents grade level six results of the administration 
of the CTBS for the nation, the state, fiv^ counties surrounding P^utnam 
County, and Putnam County. This table shows that in every instance of 
comparii^g Putnam County students to West Virginia students as a whole on 
the subsca^es of the CTBS, the West Virginia students out-performed the 
Putnam County students. When comparing Putnam County sixth graders in 
five surrounding counties on the subscale scores of the CTBS, in every 
possible case the surrounding- counties * students ti^ed (a single case) or 
outperformed Putnam County students. 

Table 3 presents student achieveipent data for grades nine and eleven 
on the CTBS in 'a manner much like that presented in^ the previous table. 
When comparing the West Virginia students in general to Putnam Xounty 
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Table -2 

Mean Percentile Scores cfn Comprehensive Tests of Basic Skills , 
drades Three and Six, as Reported May, 1981* 
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Mean Percentile Scores on Comprehensive Tests of Basic Skills , 
Grades Nin^ and Eleven, as Reported May, 1981 
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studentfil at the ninth grade lev^l, in every single case the West Virginia 
students had higher mean percentile scores on the 14 reported CTBS 
scores. County-level analysis- is even niipre revealing. Table 3 shows 
that, in every possible cell of .comparing CTBS scores between the fiye 
'surrounding counties' students to Putnam County Students, the Putnam 
County students were outperformed. 

Student achie;vement data does not- get much better 'at the eleventh 
grade level^ as shown in Table 3. Again on the 14 CTBS subscale scores^ 
West Virginia students as a whqle either tie or "beat" Putnam County 
Schools a total of nine times. When looking at Table 3 in terms of 

comparing scores from students in five surrounding counties to Putnam 

ft 

County students on CTBS, it is , revealed that in 49 out of 70 possible 
cases, ^he five Surrounding counties* students bettered the Putnam County 
students » ^ , 

Although student achievement scores on a norm-referenced test cannot 
be considered an accurate reflection of students* knowledge, they -do give 
some indication of the degree to which programs are effective. The 
superintendent and the Putnam County School Board were not satisfied that 
"all was right" in the county *s educational program. 

'It is not enough, however, to realize that a problem exists . A 
specific plan must be developed and implemented which addresses the 
problem and ^ leads toward an amelioration of it. After considering 
various strategies, the Superintendent of Putnam County Schools, with the 
support of the Putnam County School Board, decided to implement and test 
the Stallings Classroom Management Staff Development Model in a select 
number of schools in the county, involving a select group of teachers.- 
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il. Demonstration Project History 

The Putnam County Classroom Management Staff Development DeMonstra- 
tion Project sprang from the shared commitment of key project personnel 
to study and learn more about the teaching and learning process, and 
subsequently to apply this knowledge to increase student achievement. 
,Dr. Joseph C. Basile, II, Director of the Office of Educational Program 
Development, and Mr. Kenneth Higginbotham, Superintendent of Putnam 
County Schools, were sponsored to the 1980 series of Regional Exchange 
(Rx) workshops conducted by Appal^chia Educational Laboratory (AEL) , with 
the initial contact having been made by Dir. Merrill L. Meehan, Education 
Research and Development Specialist and the AEL state consultant to West 
Virginia. At the first- awareness workshop, Stallings presented het model 
for improving basic skills' instruction. Prior to this, the West Virginia 
Department of Education, through Basile and Dr. Nicholas Hobar, at that 
time the Director of the Division of Professional Development Systems,- 
had endorsed the Stallings project in 1979 in a support letter included 
in Stallings* application to the National Diffusion Network (NDN) to 
become a developer/ demonstrator. 

Because of the initial interest generated by the first AEL-Rx work- 
shop, an in-depth follow-up workshop was scheduled and was attended by 
Basile, Higginbotham, and Meehan. At this time, Higginbotham took the 
lead in organizing overtime sessions with various key actors relating to 

involving the 3t-allings Classroom Management Staff Development 't)roject in 

*• * . 

his schools. As a result * of these meetings, the staff development 
project was begun in Putnam County as a demonstration project. 

In, orde^ to implement the project in Putnam County, the West 
Virginia Department of Education funded the training of an apprentice by 
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Stallings \n November 1980. The apprentice-candidate was chosen directly 
from the -staff . under Basile's direction. The Stallings-trained 
"apprentice," Ms. Debra Sullivan," was then "loaned" to Putnam County 
Schools 'in order to implement the National Diffusion Network (NDN) 
demonstration project. 

A graphic display of the processes and procedures illustrating* the 
Putnam County Classroom Management Staff Development Demonstration 
Project is included in Appendix A. ' A calendar of events detailing the 
chronology of the project i^ included in Appendix B. ' 
III. Description of the Demonstration Site 

Putnam County is situated in the west-centcal part of West Virginia. 
Witifield, the county seat, is located near the Kanawha River,' approxi- 
mately 25 miles .northwest of Charleston, the State Capital. The general 
terrain of the county is hilly except for the broad lowlands of the 
Kanawha Valley and the rolling land of Teays Valley. According to the 
'1980 census, 38,181 persbns live in Putnam County. This number reflects 
a 38.2 percent increase in population since the 1970 census was taken. A 
ten year population prediction projects 56,324 persons in 1990 or a 47.5 
percent increase over the 1980 total. 

There are fifteen elementary schools, four middle schools , four high 
schools, and one vocational technical school in Putnam County serving a 
population of 8,261 students (1980-81 figures). Four hundred and sixty- 
four teachers and thirty-four principals and assistant principals were 
employed by the school systep during the 4980-81 school year. - 

Two secondary schools were selected, to be sites for the demonstra- 
tion project. Buffalo High School, housing 356 students and a faculty 
including four full- and part-time language arts teachers (1980-81 
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figures'), is the smallest secondary school in'the county. It is located 

4 

in a very rural area and, according to school records, draws its student 
group from a low to middle SES citizenry. Hurricane High School is the 
largest (923 students) secondary school in the county, supporting a 
language arts faculty of seven teachers (1980-81 figures). School 
records for Hurricane High School, whiqh is located p.ear a major inter- 
state highway and" is situated approximately half way between the twd 
largest cities in the State, indicate that the student population has a 
middle to high SES. ! ' , / 

A map ^ of Putnam County is included ,as Figdre 3. The names and 
locations of all schools in the county are included on the map, with the 
schools' involved in the demonstration projects being designated by 
asterisks. 
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Figure 3 

Putnam County, West Virginia and its Schools 
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IV. . Methods, and Procedures in Demons tration Project 
A. Demonstration Project Awareness Meet^ing 

A project, awareness meeting was held on January 14, 19S'j, at the 
Putnam County Schools central office in Winfield. The purpose of the 
awareness meeting was to acquaint the pdrtticipants ia the demonstration 
' project, with one another and with the scope of the Putnam County Class- 
room Management Staff Development Demonstration Project. -The roles 
various individuals 'would play in the project were discussed as well as 
the project's position in t^e total Putnam County Comprehensive Education 
Plan. Kenneth Higginbotham, Superintendent of Putnam County Schools; 
Joseph C. Basile, II, Director, Office of Educational Program Develop- 
ment, West Virginia Department of Education; and Debra Sullivan, Reading 
- Coordinator, West Virginia Department of Education, ..each spoke to the 
group, relating their perceptions of the roles in the project. Attending 
the meeting were tlie six observer trainees; the eleven language arts 
teachers from Buffalo and Hurricane High Schools; Kenneth Ruck&r, 
Director of Adolescent Curriculum for Putnam County Schools; and James 
Melton, principal of Buffalo Hi^h SchooJ. . ^ ^ 

The Superintendent of Putnam County Schools addressed the group and 
explained his. concept of a compi^ension instructional improvement progam 
for the couhtY- Such a plan would have three discrete but interrelated 
components: currl-culum alignment and articulation, classroom and school 
management, and studeht assessment. ' He indicated that while the county 
school system had many fabtors in its favor (e.g., well-paid teachers, 

\ large number " of teachers with degrees beyond the Bachelor's level, a 
booming population) that these were offset by relatively low student 
' achievement scores and feedback from^ a number of Putnam County-educated 
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Students who had dropped out of college, citing their perceived inability 
to compete academically with other Sjtudents . He told the teachers that 
their schools had been selected by him to participate in the demonstra-,^ 
tioh project because he wanted to determine the'' effects of the project in 
two very different settings. / 

The Director of the Office of Educational Program Development^ 
(WVDOE) presented the State perspective and informed the group where this 
demonstration fit within; the scope of the statewide educational system. 
He stated that the project would perhaps be a model other counties could 
use in developing their own instructional improvement programs. 

^ , ■. 

The Reading Coordinator (WVDOE), who would train observers and 
teachers, spoke of the project as being a time to learn; both from the 
successfeis and failiites thaV^ould occur. In addition, she collected 
personal information on the teachers and observers at this time, using a 
simple survey form. 

B.^ Data Collectionf Pre- intervention 

The Secondary Observa^tion Instrument (SOI), was administered the 
start of the project (pre-intervention) and again at its conclusioii: 
(post-intervention). Teacher training sessions (i.e., the intervention) 
were structured around SOI-generated individual teacher profiles and 
teacher effects/classroom management research findings. 

1 . Selection of Observers ' " 

In December 1980, ,the superintendent appointed a committee for the 
purpose of choosing persons who would be involved in collecting classroom 
observation data for the project^ This observer selection committee was 
comprised of the director of adolescent education far the county, thi^ 
principal and two teacher representatives from each high-school involved\ 
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in the project. The teacher representatives were from the language-arts 

departmeqit and would, therefore, be involved in the subsequent t^eacher 

<\ . . ' . 

tiraining session^ and data collection protess . 

. \ . - ' ' - _ 

Although Stallings primarily used trained graduate students to 

collect' classroom \observation ^ata in her projects, the superintendent' 
directe^d the committee to make its selections from the county's substi- 
tute "teacher list. This course was chosen because it was felt that the 

Putnam County teachers involved in the project would: / • 

^ ' ' . ' }. ' , • 

1. feel more comfortable with peers (i.e., teachers) col-* 

lecting data-in thei]c classrooms; 

f ' . ■ 

feel more comfortable with the data collection process if 

they kiiiew and chose the observers*, and 
3. feel more committed to the project if they Jiad a yoice in 

selecting observer trainees, 

The committee adopted the following' criteria for the ^election of 

observers from the substitute teacher list: • ^ 

general intelligence ^ " ' . 

professionalism » 

ex]ferience ' \. . . / 

academic major . « 

stability in -the community " ' ^ 

.Based upon the number of teachejrs from each high school who would be 

involved in the project, t^e committee recommended that two observers be 

chosen fbr Buffalo High School (BHS) and that four , observers be selected 

for Hurricane High School (HHS) . ' . ' 

TJtie following observer trainees were selected: 

Janice Sayre (BHS) 
Lela Johnson (BHS) 
Helen Blankenship (HHS) 
Jean Keadle (HHS) 

Glenn Christian (HHS) ' ' - . 

Lillian Roach (HHS) 
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o A brief self-reporting ' survey was used in the projept* to collect 
background data on the observers. The majori^ty (5) of the observers held 
Bachelor's ^Degrees in Education, "with the most experienced observer 
holding a^ Master's Degree plus fifty-three hours. Five ^9f the „six 
observers ' were females and the l^xtent of teaching experience ranged from 
two years as a substitute teacher » to* forty-one years as a teacher and 
counselor.- All of observers' primary experience had been at the 

adolescent educaftion level. A copy of the results of the survey .ayre 
included in Appendix C. • - ^ « ' 

2 . Observer Training 

The observer training was conducted by Dr. Jane Stallings, Teaching 
and Learning Institute, Mountain' View, 6alifarnia, and Debra Sullivan, 
West Virginia Department of Education** , The group met at Winfield High 
School Cultu^-al Center frdift 8:30 a.m. to 4:00 p^m. daily for seven 
working,, days ^between January 19 and January 27, 198^. Trainees were pa'id 
full-day substitute, rajt^es based on the county folrmula. 

O'n the ¥irst day of the workshop, _ participants were greeted by the 
Superintendent of Putnam County Schools, and the Director of Educational 
Program Development,'^ West Virginia Department of Education, each of whom 
made opening remarks detailing the' s dope of the Putnam County Classroom 
Management Staff Development Demonstration Prpject and the crucial role 
the observers woilld play throu^out the project. The ^unty Director for 
Adolescent Curriculum was present also. ^ ^ 

In an effort to model certain teacher behaviors, the workshop 
leaders used teaching strategies which utilized the various learning 
modalities. Furthermore, throughout the training, observer trainees 
•received continu'ous oral and written feedback on their progress. 




The observer training sessions included four.^^ctual ^ classroom 
practice • obsetvation periods by each obsei?ver trainee . The observa'tions 
were .conducted at. Winfield High School, using three volunteer . language^ 
a'rts teachers as the 'subjects, with trainees being paired in a daily 
rotation. Th'is pairing and rotating facilitat^ed the trainees' learning by 
providing them with opportuniti-es to have real life observation exper- 
iences, to discuss codes in light of what they experienced in the class- 
room, and to compare- their codes, with another trainee who witnessed the 
identical classroom situation. The West Virginia trainer accompanied 
trainee pairs to check on their progress and reliability. After each 
classroojj^ practice session, she me't"^ with tHe trainee pairs to discuss 
their observations and to do reliability counts and comparisons on each 
code. • , 

» During the final session, the observer trainees were evaluated. This 

^ evaluation was accomplished in several ways: 

1) a written exam, covering the meanings of the various codes, 
coding of common interactions, completion of several ^'snapshots" 

» from the observation booklet, and determining/ completing Simple 

incomplete interactions 

2) an intrarater reliability check, based on coding videotape 
sequences and oral vignettes 

3) an interrater reliability check between partners based on-4:hat 
'«> day's practice classroom observation, including completion of 

the classroom log ^ ■ 

Each trainee was ^expected to exhibit an eighty percent intrarater 
and interrater reliability rating for the codes. The ratings for the six 
trained observers ranged from eighty-one to ninety-seven percent, with an 
average of ninety-one percent . 
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' 1 ... 

Obsenvers provided both informal and written feedback a^bout the 
sessions. Althou'gh the trainees* comments were quite favorab-le about the- 
■ training sessions, one aVe^ surfaced consistently as being a jjroblem; 

V * • 

I ■ • ' . • 

namely, the . qual ity ' of the* ^videotapes used in the sessions. The video- 
tapes were second generation copies of Stallings.^ ta,pes and the auditor^j^'. 
quality of the copies wa's popr. A complete copy of each observer's 
^comments concerning the training sessions is included in Appendix D. 
3. Pre- intervention Classroom. Qbservatioris 

Before leaving the' finai obs.ervet- training ses-'sion, the observers 
were given their classroom observation assignments in -their respective 

* " i 

high schools and the*' materials needed to complete the observations.' Once 
again, the observers tWere p^id cubstitutq rates for their involvement. 
The teachers involved . were informed that classroom observations would'^be 
conducted on February 2, 3 and 4, 1981. 

Each observer coded two or three of the teachers involved in the 
study per day, one class period per teacher, over the three day data 
collectian period. Follgwing data collection on the first" and third 
days, the observers met with Sullivan, the observation trainer, to "c],ean 
up" th^ observation booklets (e.g., deleting stray marks). These 
informal meetings also servecj as a check' on the coders^ reliability in 
that the trainer scanned the booklets, looking f-or complete interaction 
sequences andproper use of the various codes^ 

The data collection materials were boxed for mailing to INTRAF, Inc. 
in Minneapolis, Minnesota, where they were computer scanned. Following 
this process, INTRAN forwarded the materials to Stallings for the final 
computer operation, generation* of teacher profiles. The turn-around time 
for sending the classroom observation materials and receiving the teacher 
profiles was 30 calendar days. 
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C Teacher Tr^initig Sessions ' ^ * 

A series of five teacher training sessions (i.e., the intervention) 
was conducted by Sullivan, teacher trainer, "following the Stallings* 
moSel. The sessions ^were held weelcly" at Winfield High School. Cultural 
Center for two and one-half hours pet session. Teachers from the schools 
met in separate sessions, with the four Buffalo High School teachers 
being scheduled -in the mourning and the seven Hurricane High School 
teachers meeting in the afternoon. Because the sessions were held diirihg 
class time, the teachers involved were granted release time and their 
classes were covered by slubstitute teachers. It is interesting to note 
here that many of the project trained observers served as substitutes 
during the teacher training sessions. After the first teacher training 
session, teachers completed a Teacher Responsibility ' for Student Achieve- 
ment Questionnaire (see companion document pn evaluation of the project). 

» ■- « 

The structure of the teacher training sessions facilitated the 

»>' ''.'"' 
building of . a support , system among teachers present. This was accom- 
plished through group scaring of ideas, successes, and failures related 
to«,teaching and learning. The session leader guided the teachers through 
certain processes and content, but called upon the teacher participants 
to focus upon certain teaching variables weekly and to attempt to imple- 
ment associated teaching behaviors in the direction of research findings. 
At the beginning of each session, they reported back to the group, 
explaining what they had attempted to do during the preceding week, and 
mentioning the problems, insights, successes, and failures they exper- 
ienced as a result. The teacher trainer visited with some of the 
teachers at various times during the course of the training session, 
coming at the teachers* invitations. 



D. Data Collection: Post-intervention 

Prior to the end of the school term, a short '*ref resher*' course was 
conducted for. the observers. The ^purpose of the one day session .on May- 
6, 1981, was tp overcome "coder drift", any movement away fj^o™ correct 
completion of the' observation instrument. Observers' knowledge about the 
codes, their speed and accuracy^^^ and their relia))ilities were verified by 
the observer trainer/ Five observers attended the session, one having 
withdrawn" from *the project for personal reasons. At tte end of the 
session, observers, received their data collection materials and pbst- 
intervention classroom observation schedules.' 

- :Foilow-up data was collected .using the^ S0I on May 11, 12, and 13, 
1981. Once again, observers "cleaned up" t>heir booklets, three per 
teacher, and the trainer' scanned their booklets for internal reliability. 
Observation materials were mailed t(5 INTPAN for scanning and were 
for-warded to Stallings for generation of teacher profiles, with-turn- 
around time beinj 18 calendar days. 

E. Teacher Training Follow-up Sessions 

The teacher trainer met individually with teachers at their schools 
on June 3 and 4, 1981. At this time, teachers Wiere given their post- 
intervention teacher profiles. The prdfiles w^re organized in such a way 
that teachers could compare their pre-\and post-intervention teaching 
behaviors. (See sample profile summation forms. Appendix E.) Teachers 
were given a second Teacher Res'ponsibility for Student Achievement 
Questionnaire, to be used as a post-intervention evaluation instrument. 
Project Evaluation 
A. Outside Evaluation 

0 

At the request of the ''county superintendent, an outside evaluator, 
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Dr. Merrill L. Meehan, Educational Research and Development Specialist 
from the Appalachia Educational Laboratory, evaluated the demonstration 
project. This evaluation utilized both process ^,nd product evaluation^ 
methods. Process eva^luation focused on the evaluative comments made by 
teachers during taped interviews upon completion- of the demonstration 
project; open-ended interviews conducted with the two building princi- 
pals, the superintendent of schools, and the trainer; teachers' concerns 
about the project, and teachers' expressed feelings/reactions as the 
demonstration project unfolded^^ Produ.gIaa^aluatioh focus^d/bn ratings of 
the teachers' Levels of Use (Hall and Lo^cks, Y^^fol the project; 
-teachers' pre-post-intervention changes in the "correct" implementation 
of specific classroom teaching behaviors; and teachers' pre- post- 
intervention changes in their perceived responsibility for student 
achievement in the classroom. - The results of this evaluation may be 
found in the companion document on the evaluation of the proJi^<J^. 
B. Final Project Meeting 

A final project meeting was held on June 8, 1981, with Higginbotham, 
Superintendent; Basile, West Virginia Department of Education; Sullivan, 
West Virginia Department of Education; and teachers involved in the 
demonstration project. The purpose^ of the m^eetin'g was to provide the 
teachers with the opportunity to voice their reactions, opinions, and 
recommendations with regard to the continuation and expansion of the 
project. In addition uo participating in small .group discussions, 
teachers completed a written reaction survey which was designed to gather 
information relative to their feelings/perceptions as the project 
unfolded. 
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V'l* Reconcelptualization 

- / , Recoriceptualizatioa has been an integral' part of the demonstration 
-project since the beginning, with the results of the evaluation compbnent. 
to be integrated into decisions regarding the ttexpansion and revision of 
the project. Since the final project meeting on June 8, 198.1, biweekly 
meetings have been held biweekly for key actors in the demonstration 
p^roject. The ptirpose of the meetings, attended by Higginbotham, Basile^, 
Meehan, arid Sullivan, has been threefpld: 

' • 1.0 To consider th'e degree'^ of success of the project 

based upon the results of the project evaluation 
and to share these' results statewide and with a 
broader national audience. 
2.0 To design and implement an expanded classroom 
a-nd instructional management component of the 
' Putnam County Comprehensive Instructional 
Improvement Program, based on recommendations 
made in the project evaluation and others 
suggested by the project management team. 
3.0 To design and implement the overall Putnam 
County Comprehensive Instructional Improvement 
Program as it relates to curriculum alignment 
and articulation, classroom and school manage- 
ment, and student assessment. 
At this time, in the area of classroom and instructional management, 
plans are being made to expand the staff development process to include 
teachers from nine elementary, middle, and secondary Putnam County 
Schools. Promotional materials are being prepared in readiness for^ 
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teacher awareness meetings which Will be held in late October and early 
November 198.1. Plans are underway to conduct observer retraining 
sessions and to collect classroom observation data in November 1981, with 
teacher draining sessions to be started in December. 1981 . • 
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CALENDAR OF EVENTS 

Putnam County Classroom Management 
Staff Development Demonstration Project 



1979 

« g 

Summer 1980 
November 10-26, 1980 
December 1980 
January 14, 1981 

January 19-27, 1981 
February 2-4, 1981 
February 5, 1981 , 

February 26, 1981 
March 3, 1981 
March 9, 1981 
March 11, 1981 
March 16, 1981 
Macch 19, 1981 
March 31, 1981 
April 1, 1981 
April 8, 1981 
April 9, 1981 
April 22, 1981 , 
May 6, 1981 
May 11-13, 1981 
May 13^ 1981 ^ 
May 27-28, 1981 



West Virginia Department-, of Education endorsement of 
S tailings project 

Appalachia Educational Laboratory 'Rx Workshops 
Apprentice training at TALI 
Observer trainee s-election process 

-Project awareness meeting with administrators, teachers 
and observers 

Observer training sessions 
Classroom observations 

Classroom observation data sent to INT^AN, Inc. for- 
processing 

Teacher trainer visit to demonstration sites 

Superintendent's decision to seek outside evaluation 

Receipt of teacher profiles 

Teacher training workshop //I 

Teacher trainer visit to demonstration sites 

Teacher training workshop #2 

Teacher trainer visit ta demofistration sites 

Teacher training workshop //3 

Teacher training workshop //4 

Teacher trainer visit to demonstration sites* 

Teacher training workshop' //5 

Observer restraining session 

Classroom observations * . 

Classroom observation dat'a sent to INTRAN, Inc. 

Outside evaluator conducts interviews ^ 
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June>l, 1981 
June 3-4, l'981 
Juhe 8, 1981 
June 1981 - present 



Receipt of teacher profiles 

Teacher training workshops to review final profiles 

Final project meeting with teachers involved in project 

Biweeklv Putnam County Comprehensive Instructional 
Improvement Program on-^ite management team meetings 
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Demonstration Project Observer Survey 

Compilation of Results of Demonstration 
Project Observer Survey 
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OBSERVER SURVEY 

I 

Grade levels taught j ' 

Subject areas taught 



Number of years experience as a teacher 
Highest degree attained _ . 



1: On what basis do you feel that observers should be selected? 



2. Do *you feel that observers should. be: (check one) 
volunteers 

____ selected by teachers involved in the study 
____ selected by administrators 

selected by SEA " t ^ 

3. How do you feel that the fact that observers are volunteers might affect 
their participation in this program?^ 



4. How do you feel that the fact that observers are paid might affect their 
participation "in this program? ^ 



5. How do you think your teaching style will be affected by your participa- 
tion in this program? [ , 



6. How do you think the w^ys in which you work with other teachers will be 
affected by your participation in this program? 



7. What did you like most about the observer training sessions? 



8. What did you like le^st about the observer training sessions? *_ 
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OBSERVER SURVEY 

Grade levels taught 

- -7-12 (3) 

- 9-12 (1) • 

- 6 and 8 (l) 

Subject areas taught 

English (3) 

- Social Studies (1) 

- Band (1) • 

- American Studies (l) 
Biology (1) 

- " Math (2) 

- Typing (1) 
Science (l) 

- Latin (1) 

Guidance Counselor (l) 
^ < - .Business Education (1) 

" - Library Science (1) 

Number of years experience as a teacher 

- 3 (2) . , 
Substitute - 2 years (1) 

) 41 (1) 

- 4+10 years as substitute (l) 

Highest degree attained 

- - B.S. (3) ' 
' - B.A. (1) 

- M.A. ± 53 hours (1) 
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1. On what basis do yoii? feel that observers should be selected? 

Should be teachers (1) 
According to teaching field (1) ^ 
Experience in classroom (3) 

Personal qualities (e.g., good judgment^) (1) 
Characteristics they exhibited as teachers (1) 
Belief in the program (1) 

2. Do you feel that observers should be: (check one) 

(0) volunteers • 

(4) selected by teachers involved in the study 

(1) selected by administr:ators 
(0) selected by SEA 

'3. How do you feel that the fact that observers are volunteers might 
affect their participation in this program? 

May not be as concerned with accuracy 
May not realize importance of task, 

Dedication to* doing a good job might not be as great, 
unless they are really very interested in project 
Volunteers would definitely be interested before par- 
ticipating 

Not sure this would make any difference" 
Volunteers may not take program as seriously ^s paid 
(Observers 

. \/ 

4. How do you feel that the fact that observers are paid m^ght affect 
their participation in this program? 

Whea pay is -received, observers vould feel Uiat they were 
doing a job that requires skill and that th^y are account- 
able for the results. 
They would have a" greater incentive to do 'a good job and 
to continue with the project. 

It is a lot of work - I'm not sure how motivated one 
^ would be without some end results. Volunteers would have 

to be very interested in education improvement. 
I do not know that it would affect participation other 
than the fact that some might not be able to take part 
without some pay. 

Paid observers would take the^ program seriously^ and try 
to be accurate ,and fair. 

5. How do you think your teaching style will be affected by your 
participation-'^in this program? 

It is impossible to participate in the program without 
absorbing the ways a teacher can become better at his/ 
her job. 

As a substitute, I have already stopped wasting so much 
time in non-task duties and have changed my attitude 
toward somfe of the students. 

I have been made aware of the necessity to encourage , 
students. 

No answer - I am retired. 

This program will greatly improve my teavchin-g style. I 
will waste less time and will have more student partici- 
pation. \ 

O ■ ■ r 



How do you think the ^ways In whicji you work' with other teachers 
will be affected by your participation in this program? 

Get along with others, be more tactful, learn to collab- 
orate with others. 

Other teachers have ideas that are valuable, and I know 
that by asking I can gain ideas to use. 
I have become aware of the importance of teachers com- 
municating with each other. 

I have a feeling that some teachers resent "observation. 
I think I will understand other methods of teachers 
better than I did before my observations. 

What did you like most about the observer training session? 
practice in classrooms 

informal, well-organized, packed with good information 
opportunity to work with others in project and to be*in 
the classrpom as an observer (2) 

similarity to classroom situations (I always have liked 
school . ) 

What did yo>u like least about the observer training sessions? 
coding videotapes (3) - necessary but tedious 
nothing - it was all good 
, length of the day 
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MEMORANDUM 



TO: Debra Sullivan 

FROM: Lela Johnson • 

SUBJECT: Secondary Observation System Training Program 

INSTRUCTORS: Jane Stallings , Debra Sullivan 

Because the Secondary Observation System Training Program is a key factor, 
in the Comprehensive Educational Development Program in Putnam County, it 
necessarily must be thorough and effective. The data used to implement the 
program must be as accurate as possible; therefore, the observers or data 
collectors must have a training program to allow for individual learning 
differences and yet get the material across in a limited amount of time. . ^ 

I was initially involved in the program when Mr. Melton, principal of, 
Buffalo High School, spoke to me briefly and asked if I would be interested. 
Because he took the time to speak to me personally and let me know it was a 
project of importance and something that he felt I should serio.usly consider, 
my interest was aroused and I decided to participate. During the first 
meeting held at the Board Office, I became convinced that the project, was 
worthwhile and that my choice to participate had been the right one. 

Since the training program was to last only seven days, the codes had to 
be learned before coming to tha first session. Everyone came prepared 
allowing us to get down to business immediately. We were very fortunate to 
have two very competent instructors, who not only taught us the difficult 
observation system, but also taught us to be better teachers. The program was 
difficult and involved a mastery of the coding system, being able to judge 
which codes to use in each different situation, and accomplishing all this 
with quickness and accuraqy. Our teachers were very effective and gave us -a 
number of different experiences 'using a variety of teaching techniques. We 
not only had practice in our class using video tapes and written vignettes, 
but we were given four English classes to code.' It must also be noted "that 
when Jane Stallings had to leave, Debra Sullivan took over alone with confi- 
dence and professionalism. We were drilled, guided, taught, and tested with 
purpose and constant positive reinforcement. 

I feel that the training program is thorough and adaptable to thie needs 
of each individual learner. I would suggest that some different video tapes 
be used — perhaps to ,be made by the county or stat^ education departments. In 
my own particular case, I would have benefited from several more practice 
sessions in actual classrooms. Aside from these few suggestions , the training 
program, in my estimation, is all that it should be. 



Debra Sullivan 
Page 2 



. The entire project has taken on a new significance for me in a very short 
period *of* time. In seven 'days I f^el that I iiave learned as much about bein^ 
a gpod teacher as I have about the coding system. The implications^ for our 
county are beneficial and important to students and educators alike. After 
being exposed to the dedication of Ken Higginbotham, Joe Basile, Jane 
Stallings, and Debra Sullivan, it would be very difficult to avoid viewing the 
project with enthusiasm and hope. 

cc: Kenneth Higginbotham 
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The observer training session that I just completed was one of the most 
educational experiences I believe I could have ever had. Truly, the things I 
learned about teaching, and hov^ to better manage classroom time was indeed 
helpful, and I just want to say "thank you" for being allowed to participate 
in the program. Altogether I felt if was very successful. ' ' 

There were, however, some areas which were a little weak, but I know from 
being with the proposers of this endeavor, not intentional. 

(1) I felt the observers chosen for this project should have been noti- 
fied and better informed by the principals of the schools selected or by the 
Superintendent's office, and^ not by the teachers involved at the selected 
schools. 

(2) Several times there was a conflict as to how to correctly code a 
specific interaction. The manual had several mistakes pertaining to this type 
of situation. 

(3) The snapshot was skipped over too' lightly at the beginning of the 
session, I felt, and then covered more extensively at the end. In my opinion 
it should have be n the other way around. 

(4) There should have been at least two more practice sessions of coding 
in an actual classroom situation. 

(5) The Video tapes that the observers had to watch for practice were 
terrible. They ^'^ere difficult to understand, and at times one could not .tell 
exactly who was speaking. ' „ a^^^ 

Th^e teachWs for the observers training session were absolutely unbeat- 
able. Dr. Stallings and Mrs. SulliVan were always positive in their ap^oach, 
which came through to everyone in the group. The instructors were always 
handing out '■praise, 7's, where as I felt perhaps I need more correction, 9's.^ 
Dr. Stallings andllrs. Sullivan did a great job with all the material they had' 
V^^over. 

I hope I have not come across as negative about the training session, or 
the project, because I feel quite the opposite. I feel this project Will 
benefit any teacher who participates with a wealth of knowledge about teaching 
and classroom management, I k^now I sure did. 

I am really grateful to ttie people who chose me to be a part of the 
project. It was a privilege^ and an honor. I sincerely wish the best for the 
project aad to everyone who made it possible. 

Thank you, 

Janice Sayre 



6'. 




Februarly 2, 1981 



CLASSROq M OBSERVATION TRAINING - PUTNAM COUNTY 
(Debra Sullivan - Instructor) 



The Secondairy Clasdroom Observation Training recently comp 
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[eted was 



effective to^ a htgh degreip considering the time and materials available. The 

instruction, the exercises land assignments were excellent. ^ ' 

i 

One recommendation I Iwould like to make is that a '^Classroom Activity" 
film of professional quality be made utilizing .actors who enunciat(i clearly, 
and using high quality lig^iting and sound recording equipment. ThjLs invest- 
ment, I believe, would pal off in shorter training time, greatej: observer 

1 * - ! 

reliability and trainee confidence., , , 




GLENN T. CHRISTIAN 



\ 
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CRITIQUE 



1. The clajss was very well taught. Both Jane anfl Debra were wonderful 

instructors. 

2. Thfe injformaiity was conducive to learning. 

3. A smal'ler ropm might be better, for heating, etc. 

4. Obserjers need m6re information well in advance of the training.. Several 
ob-serVe^s said they would like to know, more about the project. 

5. fapesj would be an excellent method of learning, but those we had were 
. , inferior in quaLity. 

6. Scheaules need to be firmed, whenever possible, to avoid conflicts with 
previously scheduled happenings. 



7. Homework assignments were well organized and very helpful. 



LILLIAN ROACH 



ft 
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APPENDIX E 



Demonstration Project 
Pre/Post Profile Summation Forms 
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DflMONSTRAtlON PRdJECTj. 
PRE (FEBRUARY) /POST (MAY) PROFILE SUMMATION 



\/ - Correctly Implemented 



TEACHER: 
SCHOOL: 



c 



PC- 

c 



6, 



Interaction Variables (Frequency of occurrence per class period) 



F5 ^ULT TO INDIVIDUAL^ STUDEJ^T 

F6 ADULT TO GROUPS Z^jZ-^^ -- "^ 

F7 T ADULT TO class"" ""^ 

" ^ STUDEN T DIRECT QUESTION READING 
FlT "adult DII^CT QUESTION READ^NG^" 
F25 ' STUDENT RESPONSE " 
F43 ' " S'TUDENT READING ALOUD • 



F1^8 
F139" 



F45 
F48 
F49 

F56 , 

F6l,_ 

F71 

F7 5 

FZ'^ 

F7b 

F9 r 

F94 

"FQ"'^ ' 
J96 
_F99" 
PI 02 



ADULT INSTRUCTING READING 

ADULT INSTRUCTING GROUPS/READING""^ 

ADULT I NS TRUCT I nO VER YONE / READ I NG^ 

M ACHINE INSTRUCTING ^ 

ALL SOCIAL COMMENTS 



'ADULT ACKNOWLEDGEMENT / READ I NG 
ADULT J>~RA I SE/SUPPORT" ' ^ ^ 

adult" corrective Yep^dback/ probing 

. ADULT BT XdBACK/G UTdANCE ^ ^ ^ 
MDULT cor rective FEEDB ACK " 
ALL ADULT MOVEMENT " / 



Recommend Doing It: 



Pre 



Post 



Implementation 




ALL INTERACTIONS/ R EADING 
all' INT ERACTIONS/TASK 
AL L INTERACTIONS/BEHAVIOR^ 
ALL IN TERACTIONS/PQSITIVE 
ALL I NTERACT I ONS / NE GAT I VE ^ 



F108 STUDENT COMMENTS ASSIGNMEN T 

FIIO' S_TUDiENT DON'T KNOW ADULT PROBES 
'Fr20 ~ ALL INtERACTlONS/CLAS S ASSIG NMENT 

F122 ADULT MANAGE" CLASS N O STUDE NT" 

F135 ' ADULT WITH OUTSIDE INTRUDER 



F136 ADULT/DIFFERENT STUDENT STARTS INTERACTION 



DIFFERENT STUDENT/ ADULT STARTS INTERACTION 
ALL INSTRUCTION 



ALL SUPPORTIVE CORRECTIONS. 



F140 ALL CORRECTIVES 



FI41 MAKING ASSIGNMENTS 



F142 ALL INTRUSIONS 



DEMONSTRATION PROJECT 
PRE (FEBRUARY) /POST (MAX) PROFILE SUMMATION 



TEACHER: 
SCHOOU 



Correctly Implemented 



Correct 



Snapshot Variables (Reported ih % of observed time) 



82 

S3 

SA 

S5 

Sb 

S7 

S8 

S9 

SIO 

Sll 

S12 

S13 

S14 

Sl!> 



TOTAL SILENT READING 
TOTAL REDING ALOUD 
TOTAL MAKING ASSIGNMENTS 



TOTAL INSTRUCTION 
TOTAL DISCUSSION 
TOTAL PRACTICE DRILL 
TOTAL WRITQ^EN ASSIGNMENTS 
TOTAL TEST TAKING 



TOTAL NON-MATH OR READING INSTRUCTION 
TOTAL SOCIAL INTERACTION 



TOTAL STUDENT UN INVOLVED 

TOTAL DIJ^cTpLINE 

TOTAL CLASSROOM MANAGEMENT 



AAl/4 






Recommend Doing It: 


Pre 


Post 


Implementation 


IE 
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